Study Of The Wealth Inequality In The Minority Game 
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To demonstrate the usefulness of physical approaches for the study of realistic economic systems, 
we investigate the inequality of players' wealth in one of the most extensively studied econophysical 
models, namely, the minority game (MG). We gauge the wealth inequality of players in the MG 
by a well-known measure in economics known as the modified Gini index. From our numerical 
Oh results, we conclude that the wealth inequality in the MG is very severe near the point of maximum 

cooperation among players, where the diversity of the strategy space is approximately equal to the 
number of strategies at play. In other words, the optimal cooperation between players comes hand 
£f>l . in hand with severe wealth inequality. We also show that our numerical results in the asymmetric 

' phase of the MG can be reproduced semi-analytically using a replica method. 



PACS numbers: 89.65.Gh, 02.50.Le, 05.45.-a, 89.75.Fb 



I. INTRODUCTION 



Econophysics is the study of economic systems by employing methods and tools developed in physics. Up to 
now, many economists have been worrying that econophysicists are just reinventing the wheel; while many physicists 
are studying properties of toy economic models that are not directly relevant to economics 0. In this paper, we 
investigate the inequality of wealth in a simple-minded econophysical model known as the minority game (MG) using 

S the so-called replica trick By doing so, we hope to make a small step forward in the application of physical 

methods when studying real economic systems. 

The MG is a simple-minded model of a complex adaptive system which captures the cooperative behavior of selfish 
players in a real market. In this game, N players have to choose one of the two possible alternatives in each turn 
based only on the minority sides in the previous M turns. The wealth of those who end up in the minority side will be 
i^i - increased by one while the wealth of the others will be reduced by one. To aid the players in making their choice, each 
of them is randomly and independently assigned S deterministic strategies once and for all when the game begins. 
Each deterministic strategy is nothing but a map from the set of all possible histories (a string of the minority side 
of the previous M turns) to the set of the two possible alternatives. All players make their choices according to their 
current best strategies In the MG, the complexity of the system is usually indicated by the control parameter 

a = 2 M+1 /NS which is the ratio of the size of the strategy space to the size of strategies at play 0,0,0- 
| Clearly, the mean attendance of either choice is N/2 as the game is symmetrical for both choices. In contrast, the 
variance of this probability, which is conventionally denoted by a 2 (A), is highly non-trivial. It attains a very small 
value when a ~ 1, indicating that the players are cooperating 0. That is why previous studies of the MG and its 
CD ■ variants focus mainly on the study of a 2 {A). 

Since the strategies are assigned once and for all to each player, it is possible that some poorly-performing players 
are somehow forced to cooperate with some well-performing peers. Therefore, it makes sense to study the inequality 
of wealth in MG in detail. 

In Section [n] we introduce a common method that measures wealth inequality in economics known as the modified 
Gini index. We then study the Gini index in the MG numerically in Section ITTTI Our numerical simulation shows 
that both the maximal cooperation point and the point of maximum wealth inequality occur around 2 M+1 m N S . 
i This confirms our suspicion that the apparent cooperation of players shown in the a 2 (A) does not tell us the complete 
story. In fact, we are able to explain the trend of a modified Gini index qualitatively using the crowd-anticrowd 
theory [l2L Hij . IHj. In particular, we find that the cooperation comes along with wealth inequality partially because 
poorly-performing players cannot change their strategies in the MG. In this way, we show that the crowd-anticrowd 
theory is not only able to explain a 2 (A), but also explains other features of other quantities in the MG. In Section llVl 
we try to reproduce our numerically simulated Gini index in the so-called asymmetric phase using the replica method, 
we recall that one has to average over the disorder variables in the conventional replica method; the direct application 
of the replica trick cannot provide the wealth distribution of players and thus the Gini index of the MG. Fortunately, 
a careful semi-analytic application of the replica method can be used to reproduce the Gini index qualitatively as a 
function of a. Finally, we wrap up by giving a brief summary of our work in Section Ivl 
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II. GINI INDEX WITH NEGATIVE WEALTH 



In order to measure the inequality of wealth among players in the MG qualitatively, we follow our economics 
colleagues employing the so-called Gini index. In the original definition, the Gini index Go m a population is the 
mean of the absolute differences between the wealth all possible pairs of players 0] . That is to say, 



1 N 

Go = l-j;Y,[l + 2(N-j)]g j . 



(1) 



In the above equation, N is the number of players in the population, gj is the wealth earned by a player divided by 
the total wealth in the population, and the g/s are ranked in ascending order, i.e., g± < g% < .. . < g^. Clearly, Go 
ranges from to 1. The larger Go, the more serious the wealth inequality. If Go = 0, the players' wealth is uniformly 
distributed. If Go — 1, one of the players possesses the total wealth of the population and the wealth inequality is 
served. However, Eq. JQ) is only applicable in two cases: (1) all players have positive wealth; or (2) all players have 
negative wealth. Since players in the MG may have positive or negative wealth, we cannot use Go, in general, to 
measure wealth inequality. We employ an extension of Go, introduced by Chen et ai, known as the modified Gini 
index G [lj| [l?], , is given by 
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where k is defined in such a way that Y^—i gj < and gj > 0. For simplicity, we refer to the modified Gini 

index G as the Gini index from now on. Just like the original Gini index Go, the modified Gini index G measures the 
normalized wealth inequality of players. Again, G ranges from to I. The larger the value of G, the more serious the 
wealth inequality. When all players are equally wealthy, i.e., k — 0, the term Ylj—i jgj vanishes and G becomes zero. 

In contrast, if the total wealth of the system is owned by a single player, i.e., gjv = 1 and the term X^jLi 1 39j = 0> then 
G attains a value of one as N — > oo. Also, G is reduced to the original Gini index Go when all players have positive 
wealth or all players have negative wealth. Moreover, G is unchanged if the wealth of each player is multiplied by a 
non-zero constant. 



III. NUMERICAL RESULTS AND QUALITATIVE EXPLANATIONS 

In this section, we investigate the wealth inequality of the players in the MG. Since we are only interested in 
studying the generic properties of the Gini index, we average the Gini index over N r = 500 independent runs. 
Because G measures the normalized wealth distribution of players rather than simply the first and second moments 
of this distribution, the time of convergence of Gini index G is much longer than that of the variance of attendance 
and it differs for different initial configurations of the system. So we employ an adaptive scheme to check for system 
equilibration before taking any measurement. Specifically, in each run, we record the time series of G until the 
absolute difference of G between 10000 successive steps is less than 10~ 6 . Then, we obtain the equilibrated value of G 
by using finite size scaling. Finally, we take G to be the average over 50 measurements each separated by 1 000 steps, 
we recall from Section [n] that G is a measure of the normalized wealth distribution. From our numerical simulation, 
G equilibrates logarithmically and slowly although the wealth of players is decreasing in each turn. We will explain 
the reason for convergence of G in detail at the end of this section. We have performed numerical simulations for the 
cases where players draw their strategies from full strategy space and reduced strategy space 0, Q respectively. The 
Gini indices obtained in these two cases are very similar. Since the analytical investigation performed in Section llVl is 
simpler if we focus on reduced strategy space, we present the numerical results based on reduced strategy space here 
for consistency. 

Let us study the Gini index averaged over the initial conditions (G)h versus the control parameter a as shown in 
Fig- n (Note that we use (.) = to denote the average over the initial configuration of the system.) Our numerical 
results show that the curves of (G)h for different M coincide, which means that the Gini index (G)h, just like the 
variance of attendance, depends only on the control parameter a in the MG. 

We now move on to discuss the properties of the Gini index (G) = as a function of a in detail. Fig. ^ shows that 
the Gini index (G)h is small when a — > 0. In other words, the wealth of all players is roughly the same in such a 
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case. In fact, the small value of (G)h can be explained by the crowd-anticrowd theory |12l lla. Il4| as follows. In the 
small a regime, players are likely to have at least one high ranking strategy at each instance, as each player possesses 
a relatively large portion of strategies of the reduced strategy space. Thus, most of the players are using the crowd 
of high ranking strategies, i.e., those high ranking strategies are overcrowded. Due to the overcrowding of strategies, 
each strategy alternatively wins and loses one virtual score repeatedly when the same history appears, under the 
period- two dynamics 0, ■ That is to say, each strategy has approximately the same probability to win for any 
history. Therefore, all players have roughly the same amount of wealth and this leads to a small Gini index (G)h- 

As the control parameter a increases, the Gini index (G)~ rises rapidly and subsequently attains its maximum 
value when the number of strategies at play is approximately equal to the reduced strategy space size. To explain 
this, we recall that the aim of each player in the MG is to maximize one's own wealth, which is achieved under 
the maximization of the global profit 8]. Subsequently, the attendance of each choice always tends to L-^/2j upon 
equilibration for all values of a since the two alternatives are symmetric in the MG. That is to say, the system always 
"distributes" approximately the same amount of wealth to the population in each turn regardless of the value of a. 
Moreover, whenever a « a c , unlike in the cases of symmetric and asymmetric phases of the MG, it is not uncommon 
for a player to hold only low ranking strategies since the number of strategies at play and the reduced strategy space 
size are of the same order. Consequently, a significant number of players are forced to use the crowd of low ranking 
strategies and keep on losing. On the other hand, those players picking the crowd of high ranking strategies have 
a higher winning probability and keep on using those strategies. Note that the ranking of the strategies is almost 
unchanged when a ~ a c |l2l Il3l fl4| . As a result, the wealth distribution of players would become relatively diverse 
and the Gini index (G)= of the population attains its maximum value when a — > a c . 

Actually, the increase in the Gini index when a — > a+ can be justified by the frozen probability of the MG. We 
recall that in the MG a player employs the virtual score system to determine which strategy to use in the next time 
step. In the asymmetric phase, the probability that a strategy assigned to a player has a virtual score asymptotically 
higher than all the other strategies assigned to the same player increases as a decreases. Some players end up using 
only one strategy after the system equilibrates, they are regard as frozen players. The frozen probability indicates the 
number of frozen players. A small frozen probability, i.e. most players in the game keep changing their best strategies, 
implies that only a few player will keep on winning or keep on losing all the time and the Gini index should be low. 
On the other hand, a high frozen probability may indicate that while some frozen players are using strategies that 
win most of time, the best performing strategies for the other frozen players are losing badly. Thus, there is a wide 
spread in wealth distribution of players. The Gini index should be high in this case. The frozen probability follows 
the same trend of Gini index as a — > aj, which further supports the validity of the result of the Gini index. Moreover, 
when a f=a a c , it is likely that those frozen players which form the majority of crowds and anti-crowds in the game use 
anti-correlated strategy pairs, resulting in effective crowd-anticrowd cancellation between frozen players. Also, those 
frozen players who picked the anti-correlated strategy pairs keep winning or keep losing throughout the game. 

After attaining the maximum value, the Gini index (G)h decreases an d g radually tends to zero when the control 
parameter a further increases. According to crowd-anticrowd theory 0,EJ0> it is because most of the strategies 
at play are uncorrelated to each other when the strategy space size becomes much larger than the number of strategies 
at play. Therefore, it is as if each player is making random choices in the game when a is large. Hence, the winning 
probability of all strategies is roughly the same. As a result, the Gini index (G)= of the population is small in this 
regime. 

As we have reasoned above, the winning probability of each individual player is steady after equilibration of the 
system. Since the wealth distribution depends solely on the winning probabilities of individual players, the gj's, and 
hence the Gini index G, converge over a sufficiently long time. Moreover, it is easy to check that the gj's converge 
logarithmically. Therefore, the equilibration time for G is much longer than that of a 2 (A). 

IV. SEMI-ANALYTICAL STUDY OF THE GINI INDEX IN MG USING THE REPLICA TRICK 

A. Methodology 

In the previous section, we have explained the wealth inequality of the players in the MG qualitatively. In fact, the 
system of the MG can be described as a disorder spin system [3, y] since the dynamics of the MG indeed minimizes 
a global function related to market predictability. In this section, we calculate the Gini index G of the population in 
MG semi-analytically by mapping the MG to a spin glass. As we shall see, this approach works well whenever a > a c . 

Let us start to link the MG, a repeated game with N players, to the spin glass. In this formalism, every player has 
to choose one out of two actions ±1 corresponding to the two alternatives at each time step. We denote the action 
of the ith player at time t by Ci (t) . After all players have chosen their actions, those players choosing the minority 
action win and gain one unit of wealth while all the others lose one. In the MG, the only public information available 
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to the players is the so-called history, which is the string of the minority action of the last M time steps. Namely, 
the history is a string, (H(t — M), . . . ,H(t — 1)) where II(t) denotes the minority action at time t. For convenience, 
we label the history by an index (i as follows: 

(jt(t) = n(t - m) x 2 M_1 + n(* - m - 1) x 2 M ~ 2 + . . . + n(t - 1). (3) 

At the beginning of the game, each player picks once and for all S strategies randomly from the strategy space. In fact, 
a strategy specifies an action i taken by the ith player for all possible histories /i = 1, . . . , 2 M . In the MG, agents 
make use of the virtual score, i.e., the hypothetical profit for using a strategy throughout the game, to evaluate the 
performance of a strategy. To guess the next global minority action, each player uses their own current best strategy 
which is the strategy with the highest virtual score at that moment. Assuming each player has S = 2 strategies which 
are labeled by '+' and '— ', we define the disorder variables {wf , £f } as: 

2 , 5, 2 W 

Here we use the spin variable Si(t) = ±1 to denote the strategy used by the ith player at time t. Thus, the action of 
this player is given by 

c i {t)=uf ) +s i {t)$ i ~ t) . (5) 

With the above formalism, we can employ a statistical tool called the replica trick 0,0 to study the stationary state 
properties of the MG by solving the ground state of the Hamiltonian H: 

N N 

H{m} = VL 2 + 2 fi^mj + (6) 

i=i i,j 

where m, = (si(t)) and fi' 1 = X)t=i w f- Note that O denotes the average over history fj, and (.) denotes the average 
over time t. In other words, our aim is to find the minimum of H{rfi} defined by: 

_ min H{m] = - lim h]nZ(J3)) s , (7) 

where the partition function 

Z(p)=Tr^ H ^. (8) 

Here, Tr,^ denotes the integral of m on [—1,1]^, {)■= denotes the average over the disorder variables (i.e., the 
quenched disorder 5 of the system) and (3 stands for the inverse temperature. In fact, the ground state solution of H 
depends on the disorder variables. However, in the thermodynamic limit, the ground state of H has a unique solution 
for all quenched disorder. Thus, in the replica calculation, we seek for ground state solution of the Hamiltonian 
H on average of the quenched disorder. In order to evaluate (lnZ)&, we construct the partition function Z n by 
studying n (a non-negative integer) replicas of the system with identical disorder variables {a^ i }. Then, we perform 
a semi-analytical continuation to extend this function for non-integer n. In this way, the average of In if over {a^} 
is reduced to 

(liiZ) s = lim -ln(Z n ) s . (9) 

n^O n 

We also define the free energy density Fp{Q,r) by 

(Z n ) 3 = j df J dQexp -[3nNFp(Q,r) , (10) 

where Q a ,b — js Ylf m i m i is the overlap matrix and r a ,b are the associated Lagrange multipliers. Hence, we can find 
the stationary state solution of H in the thermodynamic limit N — > oo by finding the minima of Fp(Q, f) as: 



(11) 
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In fact, we can find the minima in the replica symmetric (RS) ansatz by solving the saddle point equations pHIpf: 



9F ? = 0an d^ = 0Va,6. 



dr a j dQ a ,b 

In this ansatz, the matrices f, Q corresponding to mini 7 ^, are assumed to be in the following form: 



(12) 



i - r 
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q for a =/= b . 
Q for a = b . 



(13) 



and 



r a ,b 



2r for a ^ b , 
R for a = b , 



(14) 



for all a, b = 1, 2, ... , n. Therefore, using the RS ansatz, the minimum value of Fp in the n — > limit is given by 

a(l + q) 



F {RS) = limmini^Q, 

n— »0 



2/3 



In 



l+-(0-9) 
a 



2[a + (3(Q-q)} (3 



d$(A) In 



dm exp(— f3V (m\ A)) 



a/3 



{RQ-rq), 



(15) 



where $(A) is the normal distribution and the potential V(m\X) = —^ar\m + ^§-(r — R)m 2 . 



Using the saddle point equations, we arrive at 0, IIo| 



a 



= 2- 



2 1 



7T p 



T- 1- 



rf 



(16) 



where p is a disorder variable and depends on the control parameter a. The probability distribution of the 'average 
action' of a player, m, is then given by 



P(m) 



^-[5(m - 1) + <S(m + 1)] + -^ e -(p™) 2 /2 



2tt 



(17) 



where 0(p) = 1 — cri(p/\/2), 5(0) — 1 and 5(x) = whenever i^O. Note that Eqs. (|16(l and (|1 T|) are only valid for 
a > a c . For a < a c , the replica calculation cannot give correct predictions for the probability distribution of spin 
variable m because it is unable to reproduce the period-two dynamics of the system |4| . 

Our aim is to calculate the Gini index of the players in the MG using the replica trick. At first glance, one might 
argue that the distribution of gi can be reproduced analytically using the replica trick. However, the replica trick 
can only generate the average gain of a group of players rather than the wealth of an individual player. This is 
why Challet did not compute the theoretical gain of individual players analytically by using the replica trick for the 
MG. In fact, he computes the gain semi-analytically using the disorder spin variable nii measured in the simulations 
instead [T(J,|2(j. To reproduce the wealth distribution of players, we need to know the actions of each individual player 
Si(t) at time t for each individual particular quenched disorder. However, Si(t) cannot be found by the replica trick. 
So we approximate Si(t) by the disorder spin variable rrii generated stochastically from the distribution P(m) which 
is found by the replica trick. Then, the Gini index G(S) can be calculated from the wealth distribution of the players 
for that quenched disorder. As we are only interested in the generic properties of the Gini index, we calculate the Gini 
index averaged over quenched disorder (G)=- This should be done by calculating the Gini index of each individual 
quenched disorder G(S) first and then taking average over all quenched disorders. 

In practice, we perform the stochastic simulation to generate the wealth distribution of population in the MG for an 
individual quenched disorder in the following way. Before starting the simulation, the quenched disorder 2 is formed 
by allowing each player to pick two strategies randomly from the reduced strategy space. Next, each player draws 
the spin variable m from the distribution P(m) as shown in Eq. (|17f) . Those players with m = ±1 are called frozen 
players because they keep on using a strategy throughout the game. Then, in each step of the game, players choose 
one of their own strategies according to their own spin variable m to guess the next global minority side. In practice, 
the strategy used by the ith player at time t, <Ji(t), is chosen by calling a uniform random variate ( on [—1, 1]. Then 
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we set <7i(t) — 1 if m, > C an d 0i(4) — — 1 otherwise. Therefore, for the history v(t), the action of the ith player at 
time 4 can be written as 

Xi(t)=^ t) +o i (t)& t) - (18) 

Note that the history v{i) is generated randomly at each time step t in our simulation. In addition, the difference in 
the numbers of players choosing the two alternatives at time t is given by 

iV 

*(t) = 5>«(t). (19) 

i=i 

So we obtain the minority side at time 4 

0(4) = -sign(X(4)). (20) 

After determining the minority side, the wealth of the ith players, Wi(t), is updated by 

Wi(t + 1) = Wi(t) + 2S(xi(t) - 6(4)) - 1. (21) 

We repeat the above algorithm N s times for the system to equilibrate. After the equilibration, we measure on the 
Gini index of the population for the quenched disorder S using Eq. @. Then we calculate the average Gini index 
for 500 independent runs. We denote the Gini index calculated by this algorithm with averaging over the quenched 
disorder by (G)S. In fact, we find that the average Gini index (G)= converges after N s = 500P iterations, where 
P = 2 M is the number of possible histories. 



B. Semi- Analytical Results Using Stochastic Simulation 

Fig. |3 gives the Gini index obtained from semi-analytical calculation of (G)§ versus the control parameter a for 
MG with a > a c . We find that the trend of the curves of (G)§ agrees with the numerical findings. This implies 
that we have successfully reproduced the numerical results of the Gini index in the asymmetric phase of the MG by 
using the replica method. However, the curves of (G)S are systematically lower than those from numerical simulation. 
This is because the coupling between the actions of players and the dynamics of the system is completely ignored in 
our stochastic simulation as the actions of the players depend only on the spin variable m. Consequently, the global 
cooperation among the players is suppressed in our semi-analytical calculation. Hence, the wealth distribution of 
players is less diverse which results in under-estimation of the Gini index in the MG. 

To make our semi-analytical calculation more "realistic" , we allow the history v(t) to be updated sequentially by 

i/(4) = [2u(t - 1) + 0(4)] mod P, (22) 

and we denote the Gini index averaged over the quenched disorder calculated in this approach by (G)|. Note that 
(G)§ and (G)| are calculated using the same algorithm except that the history is updated in a different way. Fig. [31 
shows the Gini index (G)| versus the control parameter a in the MG. We observe that the values of (G)| agree well 
with the numerical results when a is large. According to crowd-anticrowd theory, if a is large, most strategies of 
the players are uncorrelated to each other due to the under-sampling of the strategy space. Moreover, most of the 
strategies are used by either one or none of the players in the MG whenever a — > oo. Therefore, the cooperation 
between the players can be neglected for a — » oo. In addition, the probability of the occurrence of different histories 
is not the same in the MG when a — > oo 21]. Indeed, these two conditions are satisfied in our stochastic simulation 
using the sequential history. So, the values of (G)| match the numerical estimates when a is large. 

On the other hand, when a approaches a+ , the values of (G)| become larger than the numerical results. This 
discrepancy can be explained as follows. As mentioned in Section ITTT1 since there is effective crowd-anticrowd cancel- 
lation, the history in the MG becomes more uniform as a approaches a+ plj . In contrast, although players still have 
the same chance to pick anti-correlated pairs separately at the beginning of the game in our sequential simulation, 
the strategy actually used by each player at each turn is not determined by its virtual score, but a randomly assigned 
disorder spin variable m, instead. Consequently, two players are less likely to be frozen on an anti-correlated strategy 
pair. This makes the crowd-anticrowd cancellation less effective among frozen players in our sequential simulation. 
So, the actions among these frozen players may give a strong bias in the output, especially for a ss a c , where frozen 
probability is highest. In turn, the history becomes much more non-uniform. This greatly increases the Gini index as 
some players have more chance to stay at the winning (or losing) side. 

Finally, we remark that both (G)§ and (G)| calculated by the stochastic simulation are independent of M. This 
is expected, since the results of the replica calculation do not depend explicitly on M. 
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V. CONCLUSION 

In summary, we have investigated the inequality of wealth among players in the MG using the well-known measure 
in economics called the Gini index. In particular, our numerical findings show that the wealth inequality of players is 
very severe near the point of maximum global cooperation a c . That is to say, in the minority game, global cooperation 
comes hand in hand with uneven distribution of players' wealth. Specifically, a significant number of players are forced 
to use the low ranking strategies and cooperate with those players using the high ranking strategies since the number 
of strategies at play and the reduced strategy space size are of the same order whenever a — > a c . In this respect, we 
have showed that the crowd-anticrowd theory offers a simple and effective platform to study the wealth inequality in 
the MG. 

In addition, we have studied the Gini index semi-analytically by mapping the system of the MG to a spin glass. 
With this formalism, we semi-analytically reproduce our numerically simulated Gini index in the asymmetric phase 
of MG by investigating the stationary state properties of MG using the replica trick. 
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FIG. 1: The Gini index (G)s and the variance of attendance per player a 2 /N averaged over the initial configuration versus a 
in the MG with S = 2 for different values of M. The error bar of (G)h is of order of at most 10~ 3 . The small bump around 
a = 10 for M = 7 is due to finite size effect. 
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FIG. 2: The average Gini index found in stochastic simulation using random history (G}= versus the control parameter a in 
the asymmetric phase of the MG with N s = 500P and S = 2 for different M. For comparison purpose, the solid line indicates 
the corresponding numerical results in the MG with M = 9. 




FIG. 3: The average Gini index found in stochastic simulation using sequential history (G)| versus the control parameter a in 
the asymmetric phase of MG with N s = 500P and S — 2 for different M. For comparison purpose, the solid line indicates the 
corresponding numerical results in MG with M = 9. 



